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logical thinking domain. Applying generalizability theory to the data 
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ways, identifying different sources of error and their rela^.ive 
magnitudes. Test domain was one of the large variance components of 
the total score variance, a finding suggesting that test scores 
should be interpreted from the separate domain scores rather than 
from the total score. 3 interaction effect for persons and items 
within test domains suggests the possibility of biased item sampling. 
Findings from the generalizability study further imply that the 
number of test items should be increased to more than 20 in each 
domain to attain satisfactory generalization of the STRST into its 
universe. Recommendations for improvement of the STRST are presented. 
Nine tables present study data, and two l 'ures illustrate the 
research designs. (SLD) 
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Abstract 

The purpose of the study was to investigate the empirical validity 
of general i zabi 1 i ty theory by applying two, three-facet designs 
to data from the Scientific Thinking and Research Skill Test 
(STRST) and to investigate the decision validity of the STRST. 
Implications for test developers and program evaluators were 
suggested, and also recommendations were provided for the further 
improvement of the STRST. 



ERLC 



3 



Genera 1 i zabi I i ty Trecry 

3 

A Study Applying General i zabi 1 i ty Theory to the 
Scientific Thinking and Research Skill Test 
General i zabi 1 i ty theory has been applied in various fields 
such as program evaluation (Rothman, I982), behavior observation 
(Smith S Teeter, I982), rating of instruction (Gillmore, 1930), 
evaluation of students' attitudes to school subjects (Carloni S 
Molen, 1980), and so forth. However, most of these practical 
studies did not deal with more than three facets of the theory. 

The purpose of this study was to investigate the empirical 
validity of general i zab 1 1 i ty theory by applying two, three-facet 
designs of the theory to the Scientific Thinking and Research 
Skill Test (STRST) data (Cho & Kim, I988) and to investigate 
the validity of the STRST, There are three parts in the study: 
(a) estimation of STRST variances, (b) decision study of STRST 
for follow-up studies, and (c) comparison of the STRST classical 
reliability coefficients with general i zabi 1 i ty coefficients. 

Method 

Research Design 

The research design of the study used both a G (General i zabi 1 i ty) 
study px(l:h^)xo design, 0 (Decision) study px(l:H^)xO design and 
also a G study (p:j)x(i:h^) design, D study (p: j)x(l ;H^v) design. 
Figures 1 and 2 are Venn diagrams for the px(f:h-)xo design and 
the (p:j).(i:h-) design, respect ivelyj 
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insert Figures 1 and 2. about here 



in the G stud/ px(l:h''Oxo design, persons (p) were crossed with 
test item^ (i), test content domains (h) , and test occasions (o) , 
and test items were nested within each content domain. it was 
assumed that persons were randomly sampled from an infinite 
population (^^<^^^^) y that test items and test occasions were 
randomly sampled from infinite universes, respectively (n.<N.*^^, 
n^<N^ot)) , and that test contents were fixed as two domains 
^"h~^h^^^ • Also, it was assumed that the D study pxfi.-H-OxO 
design had the same structure as the G study design {n . ^(H . ^-^co^ 

in both the G study (p: j)x(i :h'-) design and the D study 

(p: J)x (i :H'0 design, persons (p) were nested within schools (j) 

and crossed with test items (i), which were nested within test 

content domains (h) . it was assumed that persons, schools, and 

test items were random samples from an infinite population and 

universe, respectively (^^(^^^y nj<Nj>a3, n.<H ^CO) ^ and that 

test contents were fixed as two domains (n =N. =2) . 

h h 

The two designs above were balanced designs in which there 
were the same number of items within the two test content domains 
and the same number of students within each school. 
Research Subjects and Data 

Research subjects were students in grades 5 and 6 who were 
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administered both the test and retest during the development of 
the 3TRST, Two hundred fifty students, 125 from grade 5 and 125 
from grade 6 were randomly sampled from' those who were administered 
both the test and retest of the STRST in order to obtain an equal 
number of subjects from each of five schools which had been 
randomly selected from a random sample of 28 primary schools from 
1 2 c i t i es In Korea . 

The STRST consists of 13 items within the scientific skills 
and 13 items within the logical thinking domain. STRST data were 
coded 1 for right answers and 0 for wrong answers. The data to 
be analyzed were the scores on the STRST that were obtained in 
1988 duriny the project to develop identification instruments for 
the scientifically gifted in grades 5 and 6. 

Resul Ks ■ 
Variance Estimates of the STRST 

Tables 1 and 2 show the results of estimating variance 
components of the G study px(i:h''Oxo design in grade 5 and 6, 
respectively. The total variance of STRST was partitioned into 
11 components. Among them, the largest variance component in the 
proportion of the total variance was the residual effect and/or 
Interaction effect for persons and test occasions and test items 
within test domains (39.20% in grade 5 and 37. 63% in grade 6), 
the second largest variance component was the test domain effect 
in grade 5 (23.672;), and the interaction effect for persons and 
items within test domains in grade 6 (25.69?) , and the third 
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largest variance component was the interaction effect for persons 
and items within test domains in grade S (l8.5^%), and the test 
domain effect in grade 6 (17,16%). The item effect within test 
domains was the fourth largest variance component contributing 
to the differences of the test scores (8.6^^ in grade 5 and 6.53? 
in grade 6). The main effect and interaction effects of the 
test occasion which was not a facet in the (p:j)x(i:h^) design 
had a little contribution to the differences of the test scores. 



Insert Tables 1 and 2 about here 



Tables 3 ana k show the results of estimating the variances 
of the G study (p:j)x(i:h-) design in grade 5 and 6, respectively. 
The total variance of STRST scores was partitioned into 8 component 
Among them, the largest variance component in the proportion of 
the total variance was the residual and/or interaction effects 
for persons and items within schools and test domains (55.98% in 
grade 5 and SS*S2% in grade 6), the second largest variance 
component was the test domain effect (26.201 in grade 5 and 20.82? 
in grade 6), and the third largest variance component was the item 
effect within test domains (8.80? in grade 5 and 7.5U in grade 6). 
The main effect and interaction effects of school which was not 
a facet in the px(i:h-)xo design made little contribution to the 
differences of the test scores. 
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Insert Tables 3 and k about here 



In both the px(i:h*'Oxo design and the (p:j)x(i:h") design, 
test domain, test item, and interaction for persons and items 
within test domains were all significant effects on the differences 
among the test scores. In both two designs, the estimates of 
universe variances, 3'^(p\H) and ^'^{prjXH), did not show significant 
differences, suggesting that school effect made little contribution 
to the variability of the test scores. 
Decision Study of the STRST 

The results of the D study px(l:H")xO design are reported 
in Tables 5 and 6. When the number of test items was increased 
from n.' = 13 to n. *=25, the genera 1 i zabi 1 i ty coefficient, , was 
increased by .09 for n^'=2 and by Ah for n^' = l in grade 5, and 
by .08 for "^^=2 and by .10 for n^' = l in grade 6. Similar figures 
could be found in dependability, > for domain-referenced 

interpretations (Brennan, 1983, p«108). These results indicate 
that the coefficients of the D study px(l:H^)xo design were more 
influenced by the number of test items than by test occasions. 



Insert Tables 5 and 6 about here 



^ The results of the D study {p:J)x{l:H") design are reported 
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in Tables 7 and 8. The coefficients of the D study (p: J)x ( I rH-'^) 

design were dependent upon th : number of test Items, but not upon 

the number of schools. Considering the same number of test Items, 

the general I zabi 1 I ty coefficients and dependability Indices of the 

D study (p:J)x(l:H^O design (n. '=2 and n.»=5) were lower than those 

n J 

cT the D study px(I:H^)xO design (n^^'^Z and n^'=2) In both grades 
5 and 6. Howc/er, the general I zabI 1 I ty coefficients and dependability 
Indices of the D study (p:J)x(l:H^) design (n^'^S) were higher 
than those of the D study px(l:H''-)xO delsgn (n^* = 1) In grade 6, 
while the coefficients and Indices of the (p: J)x (I iH-^) design were 
lower than those of the px(l:H")xO design In grade 5. 



Insert Tables 7 and 8 about here 



Comparisons of Coefficients 

Table 9 compares genera 1 1 zab 1 1 1 ty coefficients, dependability 
indices, and classical reliability coefficients. KR-20 and Cronbach's 
alpha coefficient are the same as the general izabi 1 1 ty coefficient 
of the D study px! design (Brennan, I983, p. 13). The general ivabi 1 1 ty 
coefficient of the D study px(l:H-)xO design was only exceeded by 
the test-retest reliability coefficient. The general i zabi 1 1 ty 
coefficient of the D study (p:J)x(l:H-) design was lower than all 
others except KR-21 . Also, the dependability index of the D study 
^ px(I:H^)xO design was higher than that of the D study (p:J)x(I :H'V) 

E1\LC 
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des ign , 



Insert Table 9 about here 

D i scuss ion 
Variance Estimates of the STRST 

The observed score variance in G studies is partitioned into 
various components according to the research design, whereas in 
classical test theory analysis^ the observed score variance is 
partitioned into a true score component and an error score component. 
In this study, applying genera i i zabi 1 i ty theory to the STRST data 
resulted in the observed score variance being partitioned in two 
ways, the px(i:h")xo design and the (p:j)x(i:h") design. As a 
consequence, different sources of error and their relative 
magnitudes were identified. 

In both the G study px(i:h-)xo design and the G study 
(p:j)x(i:h") design, test domain, test item, and interaction for 
persons and items within test domains were all significant effects 
on the differences among the test scores. Among these effects, 
the test domain, which was assumed to be a fixed effect, was one 
of the large variance components of the total score variance. 
This finding suggests that test scores should be interpreted 
from the separate domain scores rather than from the total score, 
and that the assumption of two fixed domains should be reconsidered. 
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interaction effect variances in the px(l:H'*)xO design contributed 
less to the proportion of the total variance. This separation 
explains why lower general i zabi 1 i ty coefficients and dependability 
indices occured in the D study (p : J)x ( I : H-'O design, and dso means 
that the universe of genera ! i zab i 1 i ty in the D study (p: J)x ( I : H-) 
design was larger than the one in the D study px(l:H'OxO design. 

The study found that the coefficients of the 0 study px(!:H'*)xO 
design depended more on the number of test items than on the number 
of test occasions. This finding was shown by the interaction 
variance for persons and items being larger than the one for persons 
and occasions. 

When based upon the same number of test items, the general i zabi 1 i ty 
coefficients of the D study px(!:H*)xO design (n^'=2) were higher 
than those of the D study (p: J)x ( I :H''0 design (ny=5) except in 
the grade 6 D study (p:J)x(I:H^) design (n/=5) and D study 
px(l:H^)xO design (n^'=l). This exception occured because the 
universe variance of the D study (p:J)x(l:H-) design in grade 6 
was larger than in grade 5, while the universe variance of the D 
study px(!:H-)xO design in grade 6 was smaller than in grade 5. 

In the D study (p:J)x(l:H-) design^ the general i zabi I i ty 
coefficients were highly dependent upon the number of test items, 
but not upon the number of schools. The reason for this dependency 
is that the genera 1 i zabi 1 i ty coefficient of the D study (p: J)x( I : H'O 
design is dcicermined by the universe variance and the rel::cive 

ErJc . r, 
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error variance, and they are influenced by the number of test items 

rather than the number of schools. 

The findings from the D study imply that the number of test 

items should be increased to more than 20 in each domain in order 

to attain satisfactory generalization of the STRST into its universe. 
Comparisons of Coefficients 

Assuming that the number of schools, test items, and test 
occasions in the D study are the same as in the G study, the study 
found that the genera 1 i zabi 1 i ty coefficient of the D study px{l:H'OxO 
design was only exceeded by the test-retest reliability coefficient. 
This finding follows from the fact that the genera 1 i zabi 1 i ty 
coefficient for the D study px(l:H^':)xO design, eP= 6r(p\H)/(ff(p \ h) + 
0^(pO\H) + cr(pI:H\H) + a(pOI:H\H)j, and the test-retest reliability 
coefficient are closely related to the genera 1 ! zabi 1 i ty coefficient 
for the D study pxI^^xO design (n^'=2), E?'= ['j(p) + &'(pl )] /[(f{p) + 
<7{pO + <7(o0) ^ (5(plO)J, and the test-retest reliability 

coefficient for the D study pxI^^xO design (n »«'2) P =[^(0) + 

o M xx' I 

(^(pOj/ (^pi^rQ^ (^pi:*.^) • 'S known from the above three 

equations that the test-retest reliability coefficient has the same 
numerator as the genera 1 i zabi 1 i ty coefficient for the D study 
pxI^'xO design (n^*=2) which has a larger universe variance than 
the D study px(l:H^)xO design {n^»=2) (Srennan , I983, p. lk\ Lee, 
1988, p. 166). Therefore, it is clear that the test-retest 
reliability coefficient for the D study px(l:H^OxO design is 
higher than the c lera 1 i zabi 1 i ty coe.ficient for the same design. 
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Footnotes 

Whis study followed Brenrian's notational conven'Jons 

(Brennan, 1S83)* " stands for fixed facets* 
2 

n and N denote G study sample sizes and population and/or 
universe sizes, respectively, while n' and N* denote 0 study 
sample sizes and universe sizes, respectively. 
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Table 1 



Variance Estimates of STRST for the G Study px(i:h:^)xo Design; 
Grade 5 (" =125, n^=2, n^=2, n.=13) 



Effect df(a) ss(a) MS (a) a' ia\K) Proportion of 

^'^^"^ estimate (%) 



P\H 


124 


137 


.03938 


1. 10516 


.01706 


5.39 


o\H 


1 


4 


.18846 


4. 18846 


.00120 


.41 


h\H 


1 


230 


. 11215 


230. 11215 


.06855 


23.67 


i:h\H 


24 


159 


.41600 


6.64233 


.02503 


8.64 


po\H 


124 


13 . 


75385 


. 11092 


(-.00011) 0 


a 

0. 00 


ph\H 


124 


52. 


90708 


.42667 


.00712 


2.46 


oh\H 


1 




77554 


.77554 


.00029 


.10 


pi:h\K 


2,976 


658. 


04554 


.22112 


.05363 


13.54 


oi:h\H 


24 


6. 


63200 


.27633 


.00130 


.45 


poh\H 


124 


16. 


62831 


.13410 


.00157 


.54 


poi;h\H 


2,976 


338. 


52185 


.11375 


.11375 


39.20 



Total 6,499 1618.02016 .28955 



^Negative eir-timate was replaced by 0. 



100.00 
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Table 2 

Variance Estimates of STRST for the G Study pxCith^'Oxo Design: 
Grade6(n=125, n^=2, n^^=2, n. = 13) 



SS(a) MS(a) a' (a\H) Propertionof 

estimate (%) 



p\H 




124 


137 


.8606 


1.111779 


.01620 


6.47 


o\H 




1 


7 


.1115 


7.111578 


.00206 


.82 


h\H 




1 


146 


.2500 


146.250000 


.04294 


17.16 


i:h\H 




24 


110 


.2578 


4.594077 


.01633 


6.53 


po\H 




124 


17 


.4846 


.141005 


.00180 


.72 


ph\H 




124 


52. 


1154 


.420285 


.00622 


2.49 


oh\H 




• 1 


2. 


3275 


2.327538 


.00117 


.47 


pi:h\H 


2, 


976 


662. 


8960 


.222747 


.06429 


25.69 


oi:h\H 




24 


9 . 


1969 


.383205 


.00231 


.92 


poh\H 




124 


16. 


1148 


.129958 


.00275 


1.10 


poi:h\H 


2, 


976 


280. 


2646 


.094175 


.094175 


37.63 


Total 


6, 


499 


1441. 


8797 




.250245 


100.00 



Effect 
(Q:\H) 
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Table 3 

Variance Estimates of STRST for the G Study (p: i)x(i :h") Design: 
Grade 5 (np=25. 0^=5. n^=2. n.=13) 



E-ffect d£(a) SS (a) MS (a) a' (a\H) Proportion of 

(a\H) estimate(%) 



p:j\H 


120 


57.92000 


.48267 


.01222 


4.15 


j\H 


4 


19.21046 


4.80262 


.00661 


2.24 


h\H 


1 


128.80277 


128.80277 


.07717 


26.20 


i:h\H 


24 


82. 33600 


3.43067 


.02593 


8.30 


jh\H 


4 


.62954 


.15738 


(-.00037)0^ 


0.00 


ph:j\H 


120 


30.37538 


.25313 


.00679 


2.30 


ji:h\H 


96 


18.14400 


.18900 


.00096 


.33 


pi: jh\H 


2,880 


474.90462 


.16490 


.16490 


55.98 


Total 


3,249 


812.32277 




. 29458 


100.00 


a 

Nega 1 1 ve 


estimate 


was replaced 


by 0. 
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Table k 

Variance Estimates of STRST for the G Study (p:j)x(i:h") Design; 
Grade 6 (n =25, n.-=5, n^=2, n.=13) 



Effect df(a) SS(a) MS (a) ff' (a\H) Proportion of 
(a\H) estiinate(%) 





120 


70.8123 


.59010 


.01659 


6.26 


j\H 


4 


.5.7742 


1.44354 


.00113 


.43 


h\H 


1 


92.7388 


92.73877 


.05517 


20.82 


i:h\H 


24 


66.3963 


2.76651 


.01990 


7.51 


jh\H 


4 


2.3797 


.59492 


.00066 


<.01 


ph:j\H 


120 


31.4585 


.26215 


.00795 


3.00 


j i : h\H 


96 


26.7422 


. 27856 


.00479 


1.81 


pi: jh\H 


2,880 


457.1692 


.15874 


.15874 


59.92 



Total 3,249 753.4112 .26493 100.00 
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Table 5 

Results of the D Study px(l:H^OxQ Design of STRST: Grade 5 



(a\a) 



Effect 
(a\H) 



P\H 
0\K 
H\H 

I:H\H 
pO\H 



X5 n 



i*- 20 n^*- 25 



.01706 .0X706 .0X706 .0X706 •0l7o« ^.^^^ 

A/06 .0X706 .0X706 .0X706 

.00060 .00060 .00060 ,00060 .001 >n ^^^^^ 

"A-0 .00X20 .00X20 .00X20 

.00096 .00083 .00063 .00050 .000'j< 

""J6 .00083 .00063 .00050 

<.0000X <.0000X <.0000X <.0000X <.000m ^ 

""'U <.oooox <.oooox <.oooox 



PH\H 








OH\H 








pI:H\H 


.00206 


.00179 


.00134 


Ol:K\H 


.00003 


.00002 


.00002 


pO H\H 








pOI:H\H 


.00219 


.00190 


.00142 


a' (r) 


«0X706 


.01706 


.01706 


c' iS) 


.00425 


.00369 


.00276 


a' (A) 


.00584 


.00514 


.00401 


Ea» (X) 


.02131 


.02075 


.01982 




.80 


.82 


.86 


a' (X) a 


.00176 


.00162 


.00141 




.72 


.75 


.80 


1 


.74 


.77 


.81 



.01706 .0170r, 

.00221 .00744 

.00332 .0096/; 

.01927 .02450 

.89 .70 

.00126 .0024^ 

.83 .60 

.83 .64 









.00179 


.00134 


.00107 


.00004 


.00004 


.00002 


.00380 


.00284 


.00228 


.01706 


.01706 


.01706 


.00559 


.00418 


.00335 


.00766 


.00605 


.00507 


.02263 


.02X24 


.02041 


.75 


.30 


.84 


.00225 


.00204 


.00188 


.66 


.71 


.75 


.69 


.74 


.77 



Estimates assumed np*=125. 
^Estimates assumed X=\ 
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Table 6 

Results of the D Study px(l;H'V)xO Design of STRST; Grade 6 

(a\H) 



Effect 






2, no'- 


2 






Ho*- 1 




{a\H) 




















ni'- 13 


ni'« 15 


ni'« 20 


ni*-25 

X 


n^*'" 13 


nj^*» 15 


n^'w 20 




P\H 


•01620 


•01620 


•01620 


.01620 


•01620 


•01620 


.01620 


•01620 


0\H 


•00103 


•00103 


•00103 


•00103 


'00206 


.00206 


.00206 


•00206 


H\H 


- 


- 


- 


- 


- 


- 


- 


- 


I:H\H 


.00063 


.00054 


•00041 


•00033 


.00063 


.00054 


.00041 


.00033 


P0\H 


•00090 


.00090 


•00090 


•00090 


.00180 


.00180 


.00180 


•00180 


pH\H 


- 


- 


- 


- 


- 


- 


- 


- 


OH\H 


- 


- 


- 


- 


- 








OI:H\H 


•00004 


•00004 


•00003 


•00002 


.00004 


•00004 


•00003 


•00002 


pI:H\H 


.0024?' 


•00214 


•00161 


•00129 


•00247 


•00214 


.00161 


.00129 


pOH\H 


















pOI:H\H 


.00181 


.00157 


•00118 


•00094 


.00362 


.00314 


.00236 


.00188 


(r) 


.01620 


•01620 


•0X620 


.01620 


.01620 


.01620 


.01620 


.01620 


3' (5) 


.00518 


•00461 


•00363 


•00313 


•00789 


.00708 


.00577 


•00497 


?' (A) 


•00683 


•00622 


•00516 


.00451 


•01062 


•00972 


•00827 


.00738 


Za' (X) 


•02138 


•02081 


•01933 


.01933 


•02409 


•02328 


•02197 


.02117 




.76 


.78 


• 82 


• 84 


.67 


.70 


.74 


.77 


a* (X) 3 


•00182 


.00178 


•00169 


.00153 


•00292 


.00283 


•00268 


.00258 


A 


.68 


• 70 


.74 


• 76 


• 55 


.53 


.62 


.65 




.70 


• 72 


• 76 


• 73 


• 60 


.62 


• 66 


.69 



ERIC 



Estimates assumed n '=125. 

P 

Estimates assumed X=>». 
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Tablp 7 

R f;sults o f the D Study (p: J)x ( ! :H:'0 Design of STRST: Grade 5 

(a\H) 



Effect 



(5\H) 




u 


2, n^'- 5 








m 2 






13 

X 


nz •« 15 
1 


Tit •« 20 
1 


•» 25 

1 


Hj *• 30 
n^*» 20 


n j * « 4 0 
» « 20 


n j * 3 0 

sit ^3 




p : J\H 


• 0 12 22 


• 0 1222 


01223 


1 2 2 2 


.01222 


.01222 


.01222 


.01222 


J\H 


.00132 


.00132 


.00132 


.00132 


. 00022 


. 00017 


rtrt rt 2 2 


. U U U JL / 


H\H 




















■ U U JL U U 


. uuuo o 


. uuuos 




. 00065 


. 00065 


.00052 


.00052 


JH\K 


















pH:J\H 


















JI:H\H 


.00001 


.00001 


<. 00001 


<. 00001 


<. 00001 


<. 00001 


<. 00001 


<. 00001 


pI:JH\H 


. 00634 


.00550 


.00412 


.00330 


.00412 


.00412 


.00330 


.00330 


3' (r) 


.01222 


.01222 


.01222 


.01222 


.01222 


.01222 


.01222 


.01222 




. J063i 


.00550 


.00412 


.00330 


.00412 


.00412 


.00330 


.00330 


S' (^) 


.00867 


.00769 


.00609 


.00514 


.00499 


.00494 


. 00404 


.00399 


e3' (X) 


.01856 


.01772 


.01634 


.01552 


.01634 


.01634 


.01552 


.01552 


r 


.66 


.69 


.75 


.79 


.75 


.75 


.79 


.79 


^' (X)a 


.00307 


.00290 


.00262 


.00246 


.00152 


.00147 


.00136 


.00131 




.51 


.55 


.61 


.66 


.68 


.69 


.73 


.73 


5 


.58 


.61 


.67 


.70 


.71 


.71 


.75 


.75 



Estimates assumed n '=125 

P 

Estimates assumed 

ERIC 
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Table 8 

Results of the D Study (p: J)x( I ;H''0 Design of STRST; Grade 6 



o* (5\H) 



Effect 






nj 5 








2 




(5\H) 




















nj^'- 13 


n£'» 15 


n^'- 20 


nj^'- 25 


n *- 30 

J 


nj 40 


nj 30 


nj *- 40 












n^'- 20 


n^'- 20 


nj^»- 25 


n|»» 25 


p:J\H 


.01659 


.01659 


.01659 


.01659 


.01659 


.01659 


.01659 


.01659 


J\H 


.00023 


.00023 


.00023 


.00023 


.00004 


.00003 


.00004 


.00003 


H\H 


















I iH\H 


.00077 


.00066 


.00050 


.00040 


.00050 


.00050 


.00040 


.00040 


JH\H 


















pH:J\H 


















JI:H\H 


.00004 


.00003 


.00002 


.00002 


<. 00001 


<. 00001 


<. 00001 


<. 00001 


pI:JH\H 


.00611 


.00529 


.00440 


.00317 


.00440 


.00440 


.00317 


.00317 



o' (r) 
a- iS) 
o' (A) 
eS' (X) 

^ - a 

<7' (X) 

f(A) 



.01659 


.01659 


.01659 


.01659 


.01659 


.01659 


.01659 


.01659 


.00611 


.00529 


.00440 


.00317 


.00440 


.00440 


.00317 


.00317 


.00715 


.00621 


.00515 


.00382 


.00494 


. .00493 


.00361 


.00360 


.02270 


.02188 


.02099 


.01976 


.02099 


.02099 


.01976 


.01975 


.73 


.75 


.78 


.83 


.79 


.79 


.83 


.83 


.00195 


.00180 


.00155 


.00144 


.00138 


.00138 


.00123 


.00122 


.67 


.70 


.74 


.80 


.75 


.75 


*81 


.81 


.70 


.73 


.76 


.81 


.77 


.77 


.82 


*82 



ERIC 



Estimates assumed n ^=125 

P 

Estimates assumed X==X. 
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Table 9 



Comparison of Genera 1 i zabi 1 1 ty. 


Dependabi 


1 i ty, and Classical 


ReliabMity Coefficients 


Coe f f i c i en ts 


Grade 




General i zabi 1 i ty^ 






nxfl •H")xO de<?ian 


c 


80 




6 


.76 


(p:j)x(l :H'-) design 


5 


.66 




6 


.73 


Classical rel iabil i ty 






Cronbach's alpha 


5 


.73 




6 


.73 


KR-20 


5 


.73 




6 


.73 


KR-21 


5 


.62 




6 


.65 


Test-retes t 


5 


.82 




6 


.77 


Dependabi 1 i ty*^ 






px(l:H*)xO design 


5 


.72 




6 


.68 


(p:J)x(!:H^) design 


5 


.51 




6 


.57 



Estimates of general i zabi I i ty coefficients (ff) were assumed chat n.=n.' 

n .^n • • , and n -n * • 
J J o o 

Criterion score (A) for dependability indices (?^^^) was the test mean 
score of the research subjects. 
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Figure Caption 
Figure 1 , Venn diagram for px(i:h''-)xo design. 
Figure 2 . Venn diagram for (p:j)x(i:h'0 design. 
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